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AnewmeAod 

The present inventioii relates to a method and a device of manitoiing and &ult de- 
tection in industrial processes. More specifically, the present invention relates to a 
method of applying multivariate techniques in the sequential transfer of quality pa-' 
rameteis by means of score values and monitor the process widi early fault detec- 
tion. 

Tftriintftfti background 

In today^s world of outsourcing, many of ihit stqps in manufacturing process are 
actually made by other conq^anies than by the company responsible for the final 
product. Examples of products assembled in such away include cars, computers, 
^nH telephone exchanges. Hie same approach q^^lies to a product manu&ctured in 
several steps without assembly, e.g., a pharmaceutical tablet, a roll of printing paper, 
or a wafer in a semiconductor process. Sequential manu^turing makes for a strong 
need of tracking quality data dirou^ the whole manufacturing txee^ assuring that all 
components and sub-components, as well as their combinations, have adequate 
quality, fiaults are early (high up) discovered in the tree, etc. When multiple data are 
measured in process steps and component quality testing, only multivariate tools can 
adequately use the information to evaluate the quality in the tree of m a nufa cturing 
steps. 

The products of mday must meet increasing quality demands. The pit)duct quality is 
measured by many parameters and depends on many process variables in each step 
of the process chain. During each manufacturing step, process data are measured at 
certain intervals to control and monitor the process, and after each step intermediate 
quality data are measured on the sub-components and components, and dien final 
quality data are measured on the final product. However, even if many qfxsHity 
measurements are used, with reliance on traditional Statistical Process Control 
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(SFQ tbe smaU tol«atBd vaxiation of each coo^one^ 
andr^ectiaaof a poitkm of wdl woiking product 

Several teclmiques are used fortfie pmpose of numitarinje apiocess. Parametos to 
5 cheek mchide qoaliiy, yield, eneigy, product x^ection, etc.. A conventkinal ap- 
proach for monitoring a process is to consider one vaii^ 
). This approadi is not Bde(iiuUe for obtaimng tiiB best qu^ 
product in a manufectaring process, since actually several variables arc involved. 

10 Tiie most oonunonly employed^ of SPC uses single variaWeeonirol charts. 
WhHX a ^voi product or pocess is ooteidc of a specification it is indicated. The 
limitation with SPC is that only ffew variables, generally at the most around 5, can 
be used for monitoring the process. 

15 TiiequaU^ofintcimediaiBandendprodttctsfeinmostcasesdescribedbyvahiesof 
a set of variables, iSha product specification- The specifications are often used in a 
univariate mode, i.e. they are checked individually ftxt confinmation wiHrinihe 
specification value langc. This gives rise to both ftlse negative and &lse positive 
classification, smce the quality variables very tardy are independent in practice, but 

20 are treated as if tiiey were, i.e. univariately. 

It is possible to use traditional SPC to establisb when aprocess is out of specificar 
tion when only a few variables are involved. However, whenihe number of process 
variables and quaUty increase or when they interact, problems arise. Very often it is 
: 25 difScuh to detemune die soun»ofthe problem, particularly when toeinmiber of 

process variables increases. Product quality is typically a multivariate property and 
must be treated as such in order to monitor a process in diat respect 
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In otd» to optimize and control aprocess wifli several variables, projection tech- 
mques suchas Prindpsd Con^onents Analysis (PCA) and Projection to Latent 
Structure (PLS) have been applied. These techniques are wdl described (Mac Gie- 
gor et aL) and fuith» devdopmeut has been made to address die process control 
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needof tod^. S.Vf6l&etal, (Hi««chicalnwIti.blockPLS aadPC models, for eas- ^ i 
ler inteipietatioii, and as an alternative to variable seleedon. J.Oiemometrics 1 0 
(1»<5) 40^82). describes amethod ^vbeie the variables are divided into concqita- 
ally meaningful blo«tobefimsiq)pl5<nghieiTOhicalnm^^^ ^p^^^^ 
5 Tbis attows an inierpretation focused on pertinent blocks and tbeir dominant van- 
aWes. Such bloddng can be used in process modeling and moddiqg. 

Attempts basedon SPC and projection techniques have been made to control apio- 

cess. WO 99/19780 descnljes ameflwd and device for controlling an essentially 
cootinnous process eomprising at least two sub-ptoeesses, which mimmi2es the re- 
jection of die produced product. Themefliodis based upon combiningmultivariatc 
models with a processed variable vahie. A variable value for a subsequent second 
sub process is predicted based on die ooBxbhiation of the multivariate w 
processed variable vaUie. However, die method only utilizes multivariate data 
analysis in respect of controlling the process and not for checking or monitoring. 
Rntheraiore the mediod is applied only for a specific application and can not be 
used in gmeral jqqilications. 

C. WiksfrSm ef al. (Multivariate process and quality monitoring appUed to an elec- 
20 twJysis process. Part 1. Process supervision with nrallivariate control charts 

momeirics and intelligent laboraioty system 42 (1998) 221-23 1), describes Multi- 
variate Statiatieal Process Control (MSPC) applied to an electrolysis process and the 
benefit wifli mnMyariate analysis over traditional univariate analysis is discussed 
Moreover the article shows how the result fiom a multivariate principal component 
25 analysis method can be displayed graiducany in multivariate statistical coB^ 

charts. By using this InfonmationaDy efficient MSPC approach, latfaer than any inef- 
ficient SPC technique, the potential of achieving m^'or improvements in the under- 
standing and monitoring of die process is shown. The improvements are, however, 
not sufiBdent to be able to control the quality problems in complex processes unless 
: 30 ^ific experimentation has been made to make the multivariate model invertable 
and dms also c^le to detennine how the process should be modified to minimize 
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deviatioa fiom the specification profile. In MSPC as wdl as SPC ''controUing" 
shooldbe synonymofus with "chBcking** or "^aitorii^*. 

Another drawback witii the ai^liotkmof priw art to sequential manufiictiiring is 
the need to cany relevant infonnfltiQn fiom difibroxt process steps in a process 
cham» which «n not be easily achieved by known tectaniqaes, Thorefinre, a need 
exists to describe product quality in a sequent^ mcmitonng process by a multivari- 
ate niodel of the relevant quality variables ralfaar tiian tise individual variables tiiem- 
selves. 

A problem with prior art (univariate SPC) is diat the quality variables are not inde- 
pendent, but flieir int^ependmcies get lost if they aie analyzed or mcmitored indi- 
vidually. The risk for felse product approval mcreases and wh« this oocnis and is 
fed back in the supply chain the specificaticm intervals are usually narrowed in order 
to secure product. Howeva, this rarely diminates tiie proUem of fiidse product zp- 
proval and also give rise to substantial &lse refects. 

Rnmmaiv of invention 

The present invention is directed to overooming the problems set ftirth above espe- 
cially to monitor and detect fioilts at tiie earliest possible stage in a process chain. 

This is accomplished according tiie invention by a metiiod for monitoring of and 
feult detection in an industrial process^ comprising at least a first sub-pTMess and at 
least one second sub-process arranged in a process diain, comprising, for die at least 
one second sub-process the stqjs of collecting data and calcuhttmg amultivariate 
sub-model based on tixe collected data, said method being characterized by the steps 
of receiving in the first sub-process ftom tiie at least second sub-process infbnuation 
related to the multivariate sub-model calculated for the at least second subiprocess, 
collecting da^ related to the first sub-process, and calculating a multivariate sub- 
model for die first sub-process based on coUocted data and recdved infcmnation. 
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The cuneat inveDtion provides ame&od and a device finrmiiMvariate quali^r as- 
sessment and sequential transport of quality measures between subs^uent jwoduc- 
ing entities. Early fiidt detecticm in the process diain is adiieved by findt cBagDoas 
tools sudi as oudier detectiim etc.. and <m-line monitoring of new data 

fiom the beginning of the manii&ctiixe dudn. This methodology has several advanr 
tages compared to txaditioaal univariate qualiQr assessm^ The risk for filse ^od- 
uct ^proval decieasea. Miittivariaie quality assessment aUows the number of qual- 
ity variables to increase and still be meaningfill as product specification. This is due 
to the inherent capabUity of muMvaiiale teduuques to reduce dimensionaliQr with- 
out losing idievant infinmationin the data. This allows for instance indnsian of en- 
tire speclia ftom spectroscopic measuremenis to be used aS quality assessment Near 

T^fe a n erf fNiR) gepcttoscopv has become increasingbf used for this pmpose. 

It is also possible to predict product properties directly from tbe inocess, i.c. to 
translate the production state into predicted product properties, TWs is sometimes 
called soft sensors. 

In muWYariate quality assessment the quality data from good product sainples are 
used to build a mnltivaiiate model using FCA or PLS. Each produced unit is foen 
projected on this model and classified accoiding to Us dissiimlariQr to die nud^ 

The current invention use multivariBte models in sequence. The producing entity 
applies a multivariate model for describing die qualitjr. This model consisls of a 
number of latent variables, the same latent variables are used by die receiving enlitir 
as a means of diecUng die quality of each deUvered unit But diey can also be used 
as X-variables m die receiying entity's process step to give qualily assessment of 
eadi individual step taken into use into the ftirdier processing. 



The data are arranged in a dynamically updated tree wiA die root being die final 
product data and each iMMicA and twig being die data of a compwient or sub- 

cmiqKment 
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This feature concerns a novel method to analyze multivariate data from a tree 
structured ma m i^ ^^^ H Ting process. In a piefened embodiment tids novel meihod 
gives infomiatiQn about each manufactuiing step and its itsnltSs as well as die com* 
bined influmce of all upstream C^tp-tree") steps on lata: steps and on die final 

S product Preferably the novel approach allows die detection of finilts and vpscts in 
separate stqps as well as in combinations of several or all stqpSt and points to which 
process variables and steps that togedicr are related to fhae faults. Urns, an over- 
view of all the process data are obtained in a way conesponding to the structure of 
the process, providing infoimadon about the overall quality as well as the quality of 

10 each individual step. 

Preferably this novel approach provides an adequate infirastnicture to monitor a 
complicated chain of components manu&ctuiing and assembly in such a way that 
the ad^MP^A quality of the final product is assured Pertinent graphics are induded, 
15 showing tiie stams of the overall chain as well as parts and individual 8tq[)s inMrms 
of one-, two-, and three-dimensional multivaiiate control charts. Additional multi* 
vaiiate plots are included for the detailed interpretation of die patterns seen in these 
control charts. 
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20 We hero discuss the novel approach as applied to the discivte manuftcturing of a 
product consisting of components and sub-componmts, e.g., a computer, a tele- 
phone, a car, or a camera. Precisely the same approach applies also to a product 
manuiactuied in several s^s without assembly, e.g., a pharaiaceutLcal tablet^ a roll 
of printing paper, or a wafer in a semiconductor process. 

, 25 

Brief description of the drawings 

Figure 1 shows the infomiation flow in a simple straight chain sequence and quality 

* • • 

dataY. 

':.} 30 

'-•-* Figure 2 shows the infonnation flow in a sinqile example of a "fodced** sequence. 
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Figure 3 shows PLS i^gressiancoefficieols (b) for step 11, yli (left), xll andxl2 
are seen to dominaie bofli jMnodete. smdxlA is umnqxniaiKt 

Figure 4 shows PLS regression coeffideots (b) for step 11, yl2, xl 1 and xl2 are 
5 seen to dominate bofliy-modds, and xl4 is unin^wrtant 

Flgwe S shows the data structure lor a shnple process with four steps with two 
mergii^ brandies indie final stq>, 

10 

An "industrial process** means a process comprising one or^seveial si^ peifanned 

within that q)ecific process or one or several stqjs performed at sub pio^ 
could be described as a multivniafe process. 

15 

Bold characters are used for vectors and matrices* lower case for vectors. e.g^ u, 
and upper case for matrices e.g., X. 

The process consists of J st^ <i=rl , 2,. . .J), where we assume that die last (J) is the 
20 final step, giviDg the final product 

One -NIPALS-PLS round" means fitun present u's (local and flom cham below), 
use an average of diese u's, multiply that into X to give w*, nomialize w. calculate t 
and X w, and finally c as t* Y/(t*t). 
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The training set is the historical data measured on an steps fiom instances of accept- 
able product. N observations with the individual index i a=l A- - ,N), ^ese data will 

be used to devdop a modd of how data in an stqjs and in then- combfaiation should 
look for acceptable product 
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On each step 0). multiple process variables (sjO are measured, with the vahie of the 
individual observation beuxg x«,. For st*?p j. the tfainmg set data comprise the m^ 
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Optionally, after each step 0). <iuaUty variables (y^ aie measured, with the value of " ' " 
the mdividual obseivation being y^. For step j. ite tnuning set data comprise tbe 
matrix Y,. For steps lackmg qoaliQr data (y), principal compoiiBiits like calculations 
wiU be ziUMle. for stqis having qna% data PU like calcttlati^ 

A coeflBcifiut bjk shows how mudi a variable^ comributes to the model of step 1 1 . 

A Mib-piocess is a process step in a straight process chain, a foriced pi^ 
a combination of both. 

A sub-model is a multivariate modd calculated for a specific subpiocess. ^x*id» can 
inchide infinmation fiom one or several nib-models. 

Omliere could be samples that am out of a specification, outrfde a process control 
IS limil^ etc.. 

The items displayed in a score plot are the scoie vahies of the observati 
specified set of modd con^onents (model dimensions), often con^onents one and 
two, or one. two, and diree. The score values are wtigfated averages of all variables 
20 (measurements, propecties) with the weigjits detemiiiied by (a) the loadings of the 
variables of the specifiedmodel conqionents. and (b) die scaling parametm of the 

cmresponda^ model. Thus, the scores are new variaWes that constitute summ^ 
of flie origmal variables. Deviations in the score values of an observation fiom the 

Jumnal inteivals of these scores indicate the obseivation to be di&rert 
25 oiwssituatedwithindienoimalscoreintcrvals;itisanoufficr. 

A scaled law data (contribution) plot for an observation, shows the difference be- 
tween its individual variable values in scaled fomi and the conespondfaig scaled 
vahies of a reference obseivation. This reference observation is often the (hypothetic 
caO avemge of aU "good" observations (giving good final quaUty) in the training 
set, or the setpoim of manipulated variables together with the avemge values of the 
other variables. Ilie scaled raw data (contribution) plot imiicates which com^ 
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of variables that is related to the significant deviation of ibe obffiivatioa (making it 
an ondier) - fl»ese are die variables deviating the most ftom their "normal" values. 
Thm die scaled mw data (csonMbution) plot is useM fer finding die reason for an 

observation deviating from die "normal" ones, as seen in, for instance, a score plot 
or a residual std dev CDModX) ploL 

A residual Sid dev (DModX) plot describes how much die scaled data vector of each 
observadon difikts fiom its "ideal", diia being d»e model value of the observation, 
i.e., die weighted sum of die model loadings wifli the weights being die score values 
of die observation. A hnge residual std dev (DMbdX) value, significantly outside its 
normal range, indicated tbat dils observation deviates finom die model of die normal 
observations, it is an outlier. Ibe indications for process upsets are oflen seen first in 
die i«sidual std dev pModX) plot 

Detailed des erintion of die fawention 

In die following the hxvention will be described in more detail by means of exam- 
ples which are provided for iUnsHative purposes only and are not intended to limit 
the scope of die inventicm. 

like any modeling, sequential multivariate modding is madte in two phases; 

(1) a "training^ phase based on historical data leading to a multivariate model. In 
the pres»t case dds consists ai^ a diain of nmltivariaie submodels. 

(2) a "prediction** phase where die model firom phase (1) is used to evahiate new 
incim«^ng data to detect deviations fiom "ncnmal jsperation**, and predi^ 
properties of the iraulting product or infermediste product of a subprocess. 

In die present case of sequential modeling, historical data are collected for each step 
indie mauu&cturing process chain, and a sub-modd is devdoped foreadi such 
step. The models are dien connected in a chain correspMiding to the process chain 
(dus connection can be done in several slighdy difEbieac ways), and in die prediction 
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step applied oi^line to production data for diagnosis and quality assessment and 
piedfetion of qi^ty fuiCher doim the ch^ 

Eaily feult detection in tibe process chain is achieved by fiult diagnosis tods snch as 
oatiier detection etc. Plots such as contriUition, scoie» coefficients etc. can be used 
as diagnosis tools. On-line monitorii^ of new data measurod from Oe begfauung of 
the manuficlure chain^ give infoxmation about die status of die process diain in total 
as well as each of it's steps» and identifies the fiom normal process operation in out- 
liers in scores and other diagnostic plots. 

Examples 

In ibz fhllowing two small examples we will indi^^g how infimnation from one 
siep of a sequential process can be canied "down stream** by mems of scores of a 
multivariate modd of the step. Subsequent steps will use diese scores as variables 
together widi die iirocess variables in diose subsequent stq>s« 

In dus way one gets a monitcning appnoach, which a) each intermediate prodaec 
meets specification andb) msures that all intermediate products from diffoent pro- 
cess streams fit togeduar in intermediate and final products. In addition to imcess 
monitoring and only fiult detection, diis can be used, for instance, to match inter- 
mediates when die intennoediate product dififor in size, large ones go together, and 
small ones go togedi^ or» just to mate sure diat the final product has all properties 
in the right proportion, including those of its components. 

To illustrate the modeb» infomation flow, and algoxidims, two small illustrative ex- 
amples aro given below with only 5 observations and three steps in each. 

The simplest sequential algorithm is used for die illustration^ where sqparste stan- 
dard two block (X,Y) PLS models (no hierarchical stmeture) aie made for die *1eft 
end*' blocks of each chain, i.e., block (XI, Yl) in Figure 1, and blodcs (X4, Y4) and 
(X5, Y5) in Figure 2. Thereafter die scores (tl U tl2, t41, t42, t5) of diese blocks are 



12:56 fiLBIiJIg^ STOa<Ha.M RB ■> F4W l>R.S73 

ea 5^7319 

li 



included as extra process variables in the blocks CX2, X6) next to flw rif^t (down 
stream) of these "end blocks", and PLS models made of lliese blodcs. The resulting 
scores aie then used as extra process variables in fhe blodsB neart to tiw right (down 
stream), etc., tontil the end. 

This simplest way of calculation gives two PLS-components for stqpll inFiguxe 1, 
the same for stq;) 21 in Figure 2. and one conqionent for st^ 22 in Figure 2. 

Refening to Figure 1, a straight diain sequence in three steps is shown. We may 
ttiink of this as a very single example of a pharmaceutical mami&ctnring, vdieie a 
tablet is made in three consecutive steps; granulation (step 11), mixing (step 12), 
and tabletting (step 13). The three model properties we shown in table 1. 



Table 1 



Model 


Nimibcr of vari- 


Nomb6roft*fttom 


Ntoiber of meuuxBd 


Ke$alcixigo»i&ber 




ables (X's) 


pSQVioittStBp 


<|iiaHiyviffoble8(y*s) 


ofrtScampoBottB 


siepU 


4 




2 


2 


stqp 12 


3 


2 


1 


3 


step 13 


3 


3 


2 


3 



step 1 1, this first step shnulates a sin^lified gramilaiion wiA four process variables 
(e g., temperature (xl 1), flow (xl2), crmcentialion (xl3), spray pressure (xl4)) and 
two measured quality variables (responses), eg., giamiUnB particle size (yl 1) and 
homogenexly (yl2) (standard deviation of particle size). The data vataes bdowhave 
been centered (average subtracted) and scaled, to make Ibem uninteresting as such. 



Table28howsdataXl«-[xn,xl2,xl3,xl4]andYl«(yll,yl2] of step 11, toge&er 
with resulting two score vectors til and tl 2, and PLS coefficients w* and c. In the 
PLS modd, the scwes are calculated fiom dw raw data as: ^ = 3^ xgt w^*, and eacb 
y.veetor is modded by die scores as: y,„ = S« tt, c„ + f^ (residuals), or, equiva- 
lently, yi. = Zlk x& b„fc + ^ „ . The data are analyzed in original fona. with no addi- 
tional centering or scaling. 
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Table 2 



obs/vec 




Xl2 


Xl3 




y* * 


vl2 


til 


tl2 


1 


0.188 


0-O7O 


IS tl< 






0.191 


0^0 


0.062 


2 


-0316 


0.029 


-0367 


-0.373 


-A 


*0 ISO 


-0.5S3 


0.143 


3 


0,599 


0.023 


03d1 






0563 


0.951 


-0.127 


4 


-0.033 


0.312 


-0.213 




ll.UZQ 




-0.175 


0.435 


5 


•0.438 


-0.441 






A lift? 


4) 644 


•0.S03 


-OS 13 




















6 


0.63 


0.061 


0.587 


0.507 






0.963 


-0.O47 


7 


0.83 


OilOl 


OA 


0.807 






1366 


-0.212 




















w^amicl 


0.699 


0.295 


0.514 


0,401 


0.717 


0.653 






w*siide2 


0J68 


0.813 


-0.139 


-0.487 


0.41S 


0.600 






byll 


0.653 


a549 


0.311 


0.085 












0.677 


0680 


0^53 


-0.031 


1 









Data pCl and Yl), scores (tl 1 and tl2), and model coefEUaents (w*, and b) of 
step 1 1 are shown in table 2. Observation 6 and 7 constimte the "prediciian srf% 
wtncb is not used for model development, but raflier to sinralate die "on-liK?* 
nuniitcning of die process at a lata' stage. 

The regression coefficient plot of yl 1 shown in Figure 3, indifcates diat variable xl 1 
and xl2 dominate the yl 1-model and that xl4 is uninqioitant The regression coef- 
ficient plot of yl2 shown in Figure 4, indicates lhat variable xl 1 and xl2 dominate 
fl»e yl2-model and that xl4 is unimportant Further the variable xl3 is seca to be 
about half as important as die dominating xl 1 and xl2 in both y-models. 

Step 12, in this simulated mixing step, has three process variables, feed rate of the 
constituents (x21), stining rate (x22), and mixing time (x23). There is one y- 
variable, the resulting homogeneity (y2). As in step 1 1, the data are centered and 
scaled to make ifaemuiuntaesting as such. 



.5 



20 



In dus step, the influence of step 11 is modeled by means of the two scores resulting 
in the step 1 1 model. These two vectore (tl 1 and tl2) are appended to die X2-matrix 
of step 12 to give totaUy five variables (x21. x22, x23, tl I, and tl2) in die X-matrix 
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of step 12. The PLS analysis of these data gives ttiree companents. tbe scores of 
which are used as additional variables in step 13. St^ 12 data (X2 augmented wim 
die two scores of step 1 1, and Y2). scores (t21, t22. and t23), and Y - Y2. and mod- 
els coeffidents (w*, c, and b), are shown in table 3. 

5 



Tables 





x21 


x22 


x23 


til 


tl2 


y2 




121 


t22 1 


123 


I 




-0.355 


•0JS87 


0.280 


0.062 


-0.336 




•0339 


-0Jl7g 


0J64 


2 


0.197 


0.096 


0.164 


-0.553 


0.143 


-0.250 




-0.121 


0.227 


-0.456 


3 


0.427 


0.454 


0.423 


0.951 


-0,127 


0.979 




1.091 


-0.347 


-0.026 


4 


-0^58 


^.279 


4>.395 


^.175 


0.435 






4).726 


^334 


-0.104 


5 


0«098 


0.084 


0.095 


-0.503 


-0.513 


0.447 




0.095 


0.731 


0.221 
























w^endc I 


0.448 


0,436 


0.453 


0.481 


^>.4I6 


1.005 












0.Q64 


0.049 


0.091 


*OJ68 


-0.830 


0.340 










w* aiidc3 


^.409 


-0.28i 


-0J03 


0.305 


^).909 


0.380 










b y2 


0,317 


0-347 


0J71 


0.406 


-1.046 













Step 1 3, in diis simulated tabletting step, tiiere are three proc«a variables, punchmg 
pressure (x31), madiine speed (x32), and filling rate {x33). There are two y- 
10 variables, the xesulling tablet hardness (y3 1) and unifomiity (y32). As previous 
stq>s, the data are centered and scaled. ■ 

In this step, the influence of step 12 (and indvecdy of step 1 1) is modeled by means 
of die three scores resulting in the step 12 model. These toe vecton (121, t22. and 
15 t23) are appended to the X3-matiix of step 13 to give totally sbt variaUes (x3 1, x32, 
x33, t21, t22, and t23) in the X-nuitiix of stq^ 13. 



20 



The PLS analysis of &ese data gives fliree components, denoted t31, 132, and t33 
bdow. Step 1 3 sq data (X3 augmmttd with the tihree semes of step 12, and Y = 
Y3), and model coefficients (w*, c, and b), are shown in table 4. 
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Table 4 



ofas/vec 


x31 


x32 


x33 


i21 


tzz 


123 1 






t31 


t32 


x33 


1 


0.409 


-0.120 


0.1 SO 


^339 




A liCA 1 




•0128 1 


•0.105 


0326 


0.499 


1 


•0.098 


0.086 


-0.013 


-0.121 


0.2Z7 








1 -0.179 


-0.1S2 


-0.478 


3 


0.099 


0,479 


0.301 


1.091 


"0,347 




1 U.^il 


1 lift 1 


1 1.269 


-0.047 


-0.039 


A 


•0.156 


0.075 


-0.086 


-0.726 


-0.334 


^.104 1 


1 0.422 


-0.875 1 


-0.544 


0347 


-0.226 


5 


«0.254 


-0320 


-0.382 


0.095 


0,731 


0.221 r 


-1.020 


-0.117 1 


{.0.441 


-0.874 


0.244 


























asdc 1 


0.17& 


0.337 


0.279 


0.83S 


>0.280 


0.049 I 


j 0353 


1.044 1 










0:Z72 


0.264 


0.262 


-a489 


-0.736 


0.081 I 


1.102 


-0.349 1 








w* andcS 


0376 


-0.397 


0.041 


0.094 


-0.061 


0.836 [ 


0.286 


0J247 I 








1 t>y3l 


0.470 


0.297 


0399 


-0,217 


-0.927 


0345 I 












1 by3Z 


0.183 


0.161 


OJIIO 


1.065 


•0.049 


1 0.230 1 













Figne 2 has a "fisdE". where tiie last step iec«ves material (and mfinrmaticni) from 
two duuns, each with just one step. This may be seen as a simplified vadon of die 
5 ^a«iifa«> faw4«p ftf ft snaOl eaaapater. putting toaeifaer two compfments, s^ a motfier 
boaid and a power souxoe, as a last step. Ifere, m additum to ^ tzainmg set of fi^^ 

obsemitioiis. a predictioQ set widi two additional observations is used to show die 
prediction phase of the analysis. 

10 Note diatstq> 21 is identical to step 11 in Figure 1 above, and hence not shown 
again below. The dvee models have the following propoties. shown in table S. 



Tables 



Model 


vafiables QVb) 


NumbBroffsftimi 
pievjouftstap 


Numtwrofioeasitted 
pamnciteiB 


ResulliBg number of 
PI^ comptmeatB 


step 21 


4 




2 


2 


seep 22 


3 




1 


1 


6iep23 


3 


3 


2 


3 



IS stqi21inFigia»2issimulatedtohavediesamedataas8tepllabovesh0wninta- 
ble2.i.e. Xl=X4.YI=Y4.tll=t41, and tl2-«t42. and is hence not fiirthcr discussed. 
Of couxse dw vaxijOdes heie (fiw a c(m)^ta mofheiboafd nianufiichn^ 
em fiom dmse of a {diarniaceutical granulation, bat ado: centaing and scali^ 
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here are identical in values to simpUfy the examples. Heace also flie PLS model of 
dxis step is identical to that of stqi 11. 



Step 22 in Figure 2. here Ihe X-data have the same number of vaiiables and flje 
S same values as step 12 in Figure 1. However, since flierc is no step preceding step 

22 in flie fodced model, the PLS model is not identical, and hence the table of data 
and lesuhs is ^vm below. Only one PLS conqionatt is significant 

Step 22 data (X5 and Y5), score (tS), and model coefl&cients (w*, c, and b). Bolh the 
10 prediction set observations, 6 and 7, fit &e model within the S % level, hi table 6. 



Table 6 



obs/vec 


xSl 


xS2 


X53 




ys 




15 


DModX 


PmodX 


I 


-0364 


-0355 


-0.287 




-0.276 




-0380 






2 


0,197 


0.Q96 


0.164 




0,153 




0366 






3 


0-427 


0.454 


0.423 




0.431 




0,752 






4 


^.358 


-0^79 


-0.395 




-0.422 




-0398 






5 


ao98 


0.084 


0.095 




0.113 




0.160 


























6 


0J32 


0.510 


0J79 








0.816 


3360 


0^8 


7 




-0.540 


-0.521 








-0.820 


2.573 


Oj085 






















and c 1 


0.600 


0.548 


0.584 




0.S87 










1 by5 


0,352 


0321 


0342 















Step 23, in this simulated manu&cturing step canpiise time process variables, Aiee 
IS xelative position measuiements(x31,x32, and x33) of die motfaeiboaxd and of tixe 
pows^routce. There axe two y-variables, two measured voltages (y31,y32> on tiie 
mounted eonqmter. As previous steps, the data axe centered and scaled. 

Inthisstep23.tfaehifluenceofsteps21 and 22 is modeled by means of the three 
20 scores resulting in the step 21 and step 22 models. Ibese three vectors (t41,t42, and 
tS) are upended to the X-matrix of step 23 to give totally six vaiiables m X6 (x3 1 , 
x32, x33, t41, t42, and tS) of step 23. 



12S5S fiLBiauS STQCKHCILM ftB •» fiW NR.673 

08 59^7319 . 

16 



The PLS analysis of data gives Haec convaiiBiits. d»ottd*fil» t62, andtSB, 
and step 23 data (?C6 and Y6).s<»ieB, and inoddcoeCBda«8(w*,c. and b) are 
shown below in table 7. The piedidum set obsetvation 7 fits the model, ¥^1eno 6 
is a significant ontUer as shown in table 7. In a DmodX-plot no 6 would be signifi- 
cantly outside its noimal range, indicating diat this observatisn deviate from the 
model of the nonnal obsorvations and classified as an outlier 



Table 7 





x6l 


xBZ 


K63 


141 


142 




y61 


ytt2 


tei 


t62 


t63 




PModX 


1 


0^8 


^12 


0.18 


0.28 


0.062 


4.58 


0«633 


4,128 


0.05 


0.644 


0,427 






,2 


-0,OB8 


0.066 


•0.013 


-0»553 


0:i43 


0.266 


4,448 


4.189 


4.312 


4,28 


4,36 






3 


0J}99 


0.478 


0.301 


0.851 


4,127 


0.752 


0411 


1.31 


1,321 


4.226 


4,065 






4 " 




Q.07S 


-0.086 


-0.17S 


0.43* 


4,59^ 


0.422 




4.448 


Q.S67 


4.299 






5 






4,382 


4.S03 


-0«513 


0.16 


-1.02 


4.117 




4,725 


0.297 




















P 


y2 












e 




4,999 


•0.683 


0.963 


-0.048 


aei6 


4,573 


1,002 


0,494 


4,78 


0.406 


S.55S 


0.018 


7 


0 




-0,1 


1.368 




4.62 


1.072 


0JS8 


0.614 


031 


0,703 


4,143 


0.057 




wl 


1IU2 






w5 


w6 


01 


c2 












w" «no el 


0,189 


a33fi 






4.07 


0.427 


0.474 


0,929 














02 


0.178 


0,188 


0,265 


0.496 


4.757 


i.ooa 


4.634 












and c3 




-0.552 


0.051 


0.222 


4.S6S 


4.206 


4.051 


0^13 












by61 




0^67 


0.32 


0,609 


0,488 


4.5S1 




















0.044 


■EiiT 


0.043 




0.730 

















Vfiih. Figuie 2, the two piediction set observatiims are then used in the prediction 
phase of die sequ^tial analysis. Tbe prediction set (obsenration 6 and 7) give the 
values of semes and residua) standard deviations (DmodX) shown above. It is seen 
that observation 6 is radier fax away from the model and is a significant oudier. 
With more variables it would definitely be even clearer. A conmbuiion plot would 
show that the main variables deviating are x31 and x33,Le., two of the step 23 pro- 
cess variables. 



Distances to the model (residual standard deviations) of die five training set obser- 
vations (1-5) and the two prediction set observations. The first one (ira Q is seen to 
be outside the critical Unut, and hence classified as an outlier. 

Transmitting information and date between the dil^rent steps can be perfimned in 
different directions. In Figuie 2, st^ 23 may also transmit infionnatioii and data to 
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Step 21 and/or step 22. Analogously in Figure 1, step 13 w also transmit Infiaonft- 
tion and data to step 12. 

In the foUowing tart the invention further be desc^ 
vided into blodcs for each step, mUk X; indicatiog process datameasnrcd on Hep J 
and Yj indicating quality and olhw result data measured on Hit same step. Figure 5 
shows the data structure for a 6iiiQ>le process wifli fam st^s (71,72,73, and 74) wifli 
two merging branches in the final step 74. The scores tj (t7, t8, t9, and tlO) cany the 
infennatioii of X;, (X7. X8, X9. and XIO) to later steps, and the scares u, (U7, US, 
U9. and UIO) summarize Oie Y-block (¥7. Y8, Y9, and YIO) of &e same step. 

For simpli^ty we assume only one significant conqKmcat fer each dep. In reality, 
of course Htey are usually mrae. 

Hence, the model estimate in phase one has a munber of snb models. oi» fiir eadi 
step (71 to 74 in Figure 5), plus a mechanism for carrying ttie sequential transfer of 
quality parameters fiom a step forwards (down str^un) in the chain. 

There are several possible variants of alg(»cifhms to estimate the sequ^itial model 
fiom the uaining set 

A simple algoriaun would be to start with a simple PLS model for each step being 
leftmost in a chain, above step 71 and step 73. The number of components in each 
step model (Aj) is detemained so tiiat the scores of each step (t|) adequatebr capture 
file systraaatie variation in the corresponding 1^ matrices. These scores are fiien in* 
chided among ihs X-variables in the next model to the right, eidier as just exteop 
sions of the X>block, or, as separate blocks, one per conqionent. Thus, in the second 
variant, if there were Aj components in the mod^ to the left of the present step, 
there will be l+Aj blocks in a hierandiical PLS model of the present st^. 



n 
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The tesulting score(s) of <he second st^ models (one per chain in this example) are 

then canying ihe infennation to lb» nejrt stqi to the rigjit in to 

ttier the process cfaun finishes, or mages witii another chain as in Fignns S. 

In st^s where several diains merge, the procedure is tte SMue, ea^^ 
scores appear fiom each chain, and Ae extension of X indudes aU flicse scores, ei- 
tiier just as additional variables, or, as a set of one variable blocks, Aj+Ak in number, 
assuming that the previous models in two merging cludns were Aj and Ak , re^c- 

tively. 

The model is now finished, and can be tfsed in a prediction phase (wift additional 
variables, data etc.) starting with the earliest steps, and sequentially moving the re- 
sulting scores down Ae chain(s) together wifli 4e variables measured in each sub- 
sequent step. 

in a more elaborate model, one can weave the estimation bade and forth, ushig the 
model with only one component above as a start Then, in Ifae "back-ward" pliase, 
the models are updated in a standard KIPALS feshion starting firan the rightmost 
(final) Y-Wock. That will, to begin witii, produce a u-vector for tais final Mock, 
which then is carried backward to previous blocks together with its Y-summaries 
(Uj), giving after one NIPALS-PLS round a joint u-vector for ^e previous step, 
which then is carried backwards another step, etc. Once the end is reached, one has 
t-scores for the leftmost step sub models, and the directions are changed to finr- 
wards, etc., until converg^ce. 

The X-blocks of all steps arc then deflated by t*p* , and a second component started 
just as in any hierarchical PLS model. 

After an adequate number of model con^onemts (cross-validation or odier estum- 
tion of model complexity), die mode) is finished, and can be used hi aprediction 
phase starting with the earliest stq>s, and sequentially moving the resulting scores 
down the chain(s) toge&er with the variables measured in each subsequent sxep. 



12:56 RLBiyM^STOCKHQLM flB ■» f4?U NR.673 

08 59^7319 . 

19 




1. A method for momtoring of and fiiuU detection in an industrial process, con^iris- 
ing at least a fiist sub-pn>cess and at least one second sub-process ananged in a pro- 
cess chain, comprising, for the at least one second sub-process flje steps of collect- 
ing data and calculating a multivariate sub-model based on the coUeeted data, said 
method being characteraEed by the 8tq>s: 

- recwving in the first sub-process fiomn the at least second sub-process uifiinna- 
tion related to the multivariate sub-model calculated for the at least second sub- 
process, 

. collecting data related to tiie first sub-process, and 

- calculating a multivariate sub-model for the first sub-proc^ based on collected 
data and received infomiation. 

2. A method according to claim 1 , characterized by the step of transmitting infor- 
mation or data related to the multivariate sub-model calculated for the first sub- 
process to a third sab-process. 

3. A method according to daim 1 and 2, characterized by the stq> of perfonning 
information or data feedback fiom die first sub-process to the at least one second 
sub-process. 

4. A method according to any one of the preceding claims, chameterized in that the 
data collected for each sub^ffocess coo^rises process data. 

5. A method accnding to claim 1 , characterized in diat the step of transferring m- 
formation received comprises sequential transferring of qualiQr parameters by 
means of multivariate sub-model score values (tl ,t2,. . ,,tn) between foe sub- 
process in die process diain, 

6. A method according to any one of foe preceding claims, characterized in that ar- 
ranging foe collected data for the fost sub-ptocess in one matrix and calculating foe 
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sub-modd for the fct sub-process using a principal compone^ 
method. 

7. A me*od according to any one of preceding claims, ehaiartotaed in ttwt ar- 
langing the coUected data for the fint Mb^Jtoceas is in a fim W 

matrix and calculating the sub-model for die first siib-piocess uang a PLS like 
method. 

8. Amelfaodaccoidingto claim 7, characUrized by fii8tmaliw(X) comprises pro- 
cess data and the second matrix (Y) comprises qpiallQr data. 

9. A mediod according to any one of the preceding claims, characteriaed by defin- 
ing at least one plot, such as score plots, residual plots, residual standard deviation 
(DmodX) plots, contribution plots, or scaled raw data plots for the tetetpretingthe 
HMvlwig and occuning process foults. 

10. A method according to claim 9, characterized in diat oudicr detection is pro- 
vided by analysis of said at least one plot 

1 1 . A method accoiding to any one of the preceding claims, charaeteilzcd by using 
a number of multivariate sub-model observations comprising a prediction set to 
simulate the process chain. 

1 2. A method accoiding to any of the preceding daims, characterized by using a 
number of multivariate sub-model observations conqirising a prediction set to per- 
form on-line monitoiing in the inocess duin. 

1 3 . A first apparatus for monitoring of and fault detection in an industrial process 
employing multivariate data methods, said first apparatus comprising calculating 
means for calculating a first multivariate sob-model for a first sub-process, said first 
apparatus being characterized in that it comprises means for receiving firom at least 
a second ^paiatus information or data related to at a least second multivariate sub- 
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model calculated for at least a seoond sub-piocess in the indnstiial process and flat 
said calculating means is ananged to calculale the first muWvariate sub-model 
based on the information or data received ftom said appztatas and said second sub- 



14. A first apparatus according claim 13, characteriMd in ftat it comprises means 
for transmitting infonnadon or data to a third E^aratus. 

15. An apparatus according to claim 13 and 14, duraetertzed by means fi*r per- 
10 forming infonnadon or data feedbadc to the seccmd apparatus. 

16. A computer program product comprising computer readable code means wUcli, 
when run on a computer system, makes the coatpttter system perform the following 
steps: 

IS - receiving information or data fiom a first sub-process 

- recovinginfomurtion or data related to a second mifltivaiialBSu^^ 

lated at a second sub-process 

- calculating a first multivariate sub-model based Oil fi» data received firom said 

second nmltivaiiate sub-modd and said first sub-proc^s. 



17. A conq)Uter inogram product according to claim 16 comprising conqiuter read- 
able code means which, -when run cm a computer system, makes foe conqniter sys- 
tem paform the following additional step: 
. transmitting relevant information or data to a third sub-process. 
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Abatiact 

A method fat monitoriiig of and finlt detection in an industrial process, comprising 
at least a fixst sub-process and at least one second sub-process ananged in aprocess 
diain, comprising, for the at least one second sub-process the steps of coUecdng 
S data and calculating a multivariate sub-modd based on tiie collected daia» said 

method being chaiacterizedby the steps of receiving in the first sub-process froim 
die at least second sub-process information related to the multivariate sub-modd 
calculated for the at least second sub-process, coUecting data related to the first sub- 
process, and calculating a multivariate sub-model for the first sub-process based on 
10 coUected data and received infionnatiim. 



